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Abstract. We present a solvable model for describing quantitatively situations where the individual be- 
haviour of agents in a group "percolates" to collective behaviour of the group as a whole as a result of 
mutual influence between the agents. 
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1 Introduction 



One very common interaction between the individuals of a 
group is the tendency to imitate each other. Under certain 
conditions this might be expected to critically affect the 
behaviour of the group as a whole. It may be interesting to 
have a quantitative understanding of the conditions under 
which individual patterns of behaviour may propagate to 
a group behaviour as a result of mutual influence among 
a few neighbors. As another example we may consider the 
problem of ensuring the reliability in functioning of a com- 
plex machinery by increasing redundancies. Typically the 
"parallel" components cannot be made completely inde- 
pendent. How does reliability generally depend on redun- 
dancy if failure propagation is possible? This is one major 
question in security analyses Q]. There are further exam- 
ples with similar problem setting: the dynamics of certain 
phase transitions, critical reactions, epidemic models, etc. 

Here we would like to analyze how induced behaviour 
can lead to collective effects in the frame of a probabilis- 
tic model introduced earlier ||] and which can be solved 
exactly. Thereby we restrict ourselves to the very elemen- 
tary mechanism of imitation and we do not attempt to 
include more refined interactions, such as beliefs, goals, 
cooperation, competition, etc - see, e.g., Q. For this case 
we can provide a solution in closed form. The model will 
be described and discussed in section 2 and its solution in 
section 3. Here we also define a Monte-Carlo simulation 
by interpreting the closed solution as a partition func- 
tion. Approximations permiting some qualitative insight 
are discussed in Section 4. In Section 5 we present and 
discuss the results for some representative cases. Here we 



use the Monte-Carlo simulation to treat large ensembles 
of agents with "realistic" correlations. 



2 The probabilistic model 

We consider a set Af consisting of n points, labeled i = 
1, . . . , n, each of which can spontaneously burst (and "dis- 
appear" ) with probability wqi and let Kij be the induced 
probability that point i bursts because j has bursted. 

If these points represent the parallel components of a 
machinery, the functioning of the latter is ensured as long 
as at least one of the components works. For the behaviour 
of a group of agents the relevant question is again whether 
(practically) all agents show the same behaviour. The key 
quantity is therefore the probability with which all points 
have bursted: 



W = W{n) = W{n; {wq, K}). 
We also define the "no-propagation" probabilities 

Lij = 1 — Kij 
and introduce the following simplifying assumptions: 

1) Symmetry: 

K — K ■ 

2) Independence of "no-propagation" events: 

-^1(23) = -^12^137 



(1) 
(2) 

(3) 
(4) 



i.e. the probability that point 1 bursts because 2 and 
3 have both bursted is 



Work supported in part by the United States Department -^1(23) = 1 ^ (1 ^ -^12) (1 ^-^^13) = K12 + Ki^ — Ki2Ki^. 

of Energy under Grant No. DE-FG02-84ER40158. (5) 
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Notice that the absence of time evolution in this model 
implies that, in a real situation, the whole development is 
expected to take place in a very short time such that no pa- 
rameter changes appreciably. The simplifying assumptions 
1), 2) are of course limitations, we can imagine, however, 
many realistic situations under which they hold approxi- 
mately. Symmetry, for instance, may well be expected to 
hold on the average in a group of similar agents (the birds 
in a flock, say). The independence assumption depends on 
the real interactions. 

For illustration consider the following "temperature 
model" : 3 points isolated in an enclosure, with the burst- 
ing probability for point ' 1 ' described by some monotonic 
function of the ambient temperature. Assume that burst- 
ing of a point increases the average temperature by AT. 
We ignite points '2' and '3' and see what happens with '1'. 
If only '2' or '3' had bursted, '1' will go off with probabil- 
ity P{AT), while if both '2' and '3' went off the ambient 
temperature is 2 AT and '1' will explode with probability 
P{2AT). Then (|) would require: 



P{2AT) = 2P{AT) - P{ATf, 
or, with h{T) = -ln(l - P(T)), 

h{2T) = 2/i(T), 



(6) 



(7) 



with solution h{T) — aT. Hence in this "temperature 
model" only: 

P{T) = 1 - e-"^ (8) 

is compatible with (|^) . In particular, a threshold behaviour 
hke P{T) = 9{T - To) will violate (|) if AT < Tq < 2AT. 
We shall retain, however, for this analysis the indepen- 
dence assumption (we shall indicate below how one can 
relax it when the dynamics of the interaction is known). 

Before we proceed and solve the model notice the fol- 
lowing four limiting cases: 





= : 


W = 


VFo(n 




= 1 : 


W = 


Wi{n 




= : 


w = 


0; 




= 1 : 


w = 


1. 



i=l 



(9) 



(11) 
(12) 



They are helpful for tests, normalization, etc. 



a's, {a} — n. Let oj denote a subset of a's; there are 
22n(n-i) different cj's (including the empty set 0). For the 
time being we shall take woi — wo independent on i, then 
W is of the form: 



W = W{n, wo, {Ka}) = ^ a n 



(13) 



with the last factor taken to be 1 for w = 0. Putting K = 1 
on a subset of H and in the rest we define: 

W^- = W^lif„=i ifaec., K„=o (14) 
and we have: 

Let for cj' C to: 

I _ /_i\(nr. of elements of cj)-(nr. of elements of uj') 
then we can invert (n5h to obtain 



(17) 



We next evaluate . Each w achieves a partition of M 
in the following way: if {i, j} G lo we join the points i and j. 
Thus N is partitioned into (non-empty) connected subsets 
v^^^ labeled with the index k and containing rS^^ , ,.. . 



points, n'lf' > 0, such that J2k "fc^"* = Then: 



'-fc 

= n (i - (1 - ^o)"^' 

k 

and thus from (|l|) 

uj(Zf2 uj' Ccj k 



(18) 



After rearranging the terms using ([iq) , (|19[) gives 



(19) 



ujC.O k 

Y[K^ Y[ il-K^'). (20) 

The extension to different w^i is straightforward and leads 
to the general solution: 



3 Exact solutions 

3.1 Combinatorial solution. 

Starting to solve the model we first remark: 

in following the propagation of the bursts each Kij can be 
used only once: there is no way to get something like Kfj . 

It is convenient to introduce the notation a = [ij) for 
the non-ordered pair {i, j}. There are hn{n — 1) different 



w{n- {wo,K}) = E n h - n (1 - ^o») 

JJi^a n (1-^-')- (21) 



a'^Cf; 



The sum over lo is taken over all subsets of X?, including 
the empty set and where fl is the set of all a's, and 
C2 is the complement of the set uj iw Q. 
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3.2 Iterative solution. 

It is helpful to write down also an iterative solution of 
the model. Consider a set rj of points out of which only a 
subset a is still untouched, and consider all the ways the 
failure can propagate from the points in to those in a, 
then the probability that also a blows up is: 

pivw)=j2 n fi - n 

n ( n ^^^-l ^H^)' Pivm^l (22) 
and we have: 

Win;{wo,K})^Y. H wo^l[{l ~ woj)P{Af\<j). 

__ (23) 
In ( P2| , p3|) all inclusions are strict and go also over the 
empty set. 

For the case of "homogeneous interaction" 



and we have (see (D-2 



(E2,E3) simplify considerably: 



(24) 



i-i 



Pm,i = (fc) (1 - V^'-y-^L^^'^Pi^k (25) 



(26) 



Finally let us remark that in the frame of an explicit 
model for the interaction one can relax the assumption 
(^ and directly construct the compound probabilities ap- 
pearing in (^2|). For instance, for the "temperature model" 
of section 2 we only need to substitute in (pT 



n 



1 - p, 




(27) 



where is the increase in temperature at site 'i' due to 
the bursting of point 'j' and Pi{T) is the probability that 
point 'i' explodes when the ambient temperature is T. 



3.3 Monte Carlo analysis 

A Monte Carlo simulation can be set up based on 
We define for arbitrary p partition functions: 



where 



(28) 



(29) 



Zo = l, Zi = W{n). (30) 

Starting from any partition function Zp we can write W{n) 
as an average: 



W{n) = 



(31) 



in particular (see (|30|)): 

Win) 



(Wo)o. 



(32) 



The MC procedure uses the terms in Zp as Boltzmann- 
Gibbs factors to achieve an importance sampling of i/'^ 
partitions. In actual simulations using p = 0, 0.5 or 1 the 
results were similar, therefore we used for the systematic 
analysis p ~ 0, i.e. eq. (]3^), which is faster. Then the 
Metropolis algorithm, which produces new partitions by 
adding or removing "bonds" a = (ij) one at a time, is local 
(and vectorizable). Note that since the Wo are positive, 
lack of convergence in the MC simulation based on ( p2[ ) is 
likely to show up as underestimation of the exact result. 

Whenever we could compare the results of the Monte 
Carlo simulation with exact summation of either the com- 
binatorial (^ 21 ) or the iterative (p^ , p3|) solution we have 
found very good agreement - see section 5. 



4 Approximations 

4.1 Mean Field approximation 

We introduce an "effective" bursting probability Wi via 
the consistency equation 



1 - = (1 - woi) ]^(1 - WjKij). 



(33) 



We shall in the following assume translational invariance, 
that is, woi = Wo and Kij = K\i_j\. For finite systems 
we shall assume periodic boundary conditions. Then the 
mean field equation reads: 



1 — u) = (1 — wo)exp I ^ ln(l — wK^) 



w can be found iteratively. A rough estimate is: 



w ~ 1 — (1 — u;o)e 



(34) 



(35) 



i/=i 



with some A 0{\). The parameter /C has an intuitive 
meaning: it gives the average number of points which can 
be affected by one point. We then have: 

InW^(n) = n\nw - -(1 - Wo)c'"""^'^, (36) 

which indicates that the behaviour of W{n) is determined 
by the dependence on n of /C. 
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4.2 A lower limit 



A more refined approximation can be derived which, for 
the case of homogeneous interaction ( p^ provides a lower 
bound for W(n). We start from the iterative solution ( [2^j2^ 
and assume that for some A we have: 



Pia\T)>l[il-F,{a;X)) 

jeer, j#i 



(here C r C cr C r;). Since all contributions to ( P2[ ) are 
positive we can then write: 



(37) 
(38) 



r C<7 



n |i n^. 



leC: 



n 


' n 




2Gt 







n 



il-F,ia;X)) H L, 



> 



llii-FMmm 



If we can prove that there exists a < A < 1 such that 
the last inequality holds, then we have: 

Win; {wo, K}) > [| (1 - F.iAf; X)il - wo^)) - 

\{{l~F,{M;X)){l-woi). (40) 

In the homogeneous interaction case we can show that 
a A > can always be found such that (39) holds. We 
have: 

i^,(m;A) = (l-AK)"-i (41) 
and we must show that for all to, I < m: 

[1 - (1 - XKy-\l - A')™-']' > [l - (1 - Aif)"-i]' 



[(l-(l-Ai^)'-i)(l-if)"-'] 



(42) 



The expression in the square brackets on the left hand side 
decreases with increasing I, while those on the right hand 
side do not. Therefore the worst case is I = m — 1 and it 
is enough to prove that: 

(1 - A-)]""' > [1 - (1 - A/O^^T"' 



[l - (1 - XKY''-^ 
+ [{1 - {1 - XKr-^){l - K)] 



K-0.200 - 
K-0.100 - 
K-0.050 - 
K-0.020 
K-0.010 
K-0.005 



Fig. 1. A satisfying ( j^^ vs n for various K. For values of X 
below the curves the formulae provide lower bounds. 



5 Results and Discussion 

In the introduction we asked about the collective effects of 
induced behaviour of agents in an ensemble. As we have 
noticed, various specific questions can be asked in this 
context. They can all be subsumed under some general 
questions, which in the above model can be exemplified 
as follows: 

Question 1: How does the total burst (failure) probability 
W{n, wq, {Kij}) behave with increasing n for various types 
of "aggregation", distinguished by the way in which the 
mutual influence between systems depends on n? 

As an instructive example we consider a 1-dimensional 
ensemble and put n points equidistantly on a circle. We 
assume "finite correlation length" ^: 



with 



d,j = mm{\i~ j\,n- \i-j\), 
e(n) =^0"". 



(44) 
(45) 

(46) 



(43) 



Hence for a = 1 we have an intensive aggregation (more 
and more points come under the influence of a single one 
while the size of the ensemble measured in correlation 
lengths stays fixed) and for a = an extensive aggrega- 
tion (the density of points stays constant while the total 
volume increases). < a < 1 interpolates between these 
situations (we are not concerned here with the dynamics 
of the aggregation: attraction, repulsion etc but just take 
the aggregation law as given) . 

A rough impression is offered by the mean field ap- 
proximation. For large n and small wq, K: 



For m — 2 ( p3[ ) is satisfied for any A < 1. For m ^ 1/K 
( p3| ) is satisfied for A > 1/2 and with increasing to the 
bound on A goes toward 1. More precise numerical bounds 
are give n in Fig. |l|. For the general correlation case we may 
use (|40|) as an alternative to the mean field approximation. 



and 



K. ~ a^on" (47) 



InVF(n) - -(1 - u;o)exp (Inn - aX^on") , (48) 
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alpha=1, approx. 




alpha=1.00 




alpha=0.75 




alpha=0.67 




alpha=0.60 




alpha=0.00 








exact (all cases) 

MC, alpha^l ."~ 
MC, alpha=0. 
MC, alpha=0. 
MC, alpha=0. 
MC, alpha=0. 
MC, alpha=0. 

wO"n 



Fig. 2. Win) vs n from the mean field approximation using the 
iterative solution of eq. (j^^; the line identified by ^'approx. " 
uses the further approximation ^4^- '^^^ t^o = 0.1, a = 
0.3, ^0 = 1/3.5 - see (^j^^. The different aggregation types 
are identified by ol. 




exact, 
ref.appr., 
m.f.appr., 
MC, 

exact, 
ref.appr., 
m.f.appr.. 



w_0=0.2, K-0.20 
w_0=0.2, K-0.20 - 
w_0=0.2, K-0.20 - 
w_0=0.2, K-0.20 
w_0=0.2, K-0.10 ^ 
w_0=0.2, K-0.10 - 
w_0=0.2, K-0.10 - 
w_0=0.2, K-0.10 
w_0=0.2, K-0.05 ^ 
w_0=0.2, K=0.05 
w_0=0.2, K-0.05 
w_0=0.2, K-0.05 



Fig. 3. W{n) for homogeneous interaction (infinite correlation 
length) from: the Monte Carlo simulation, the exact summation 
of the iterative solution the \efined approximation" 

(with the corresponding minimal values of X from Fig. ^ 
and the mean field approximation ^3^. Here wq = 0.2, K = 
0.05, 0.1 and 0.2. 



see 



), which has a minimum for: 



(49) 



above which W{n) goes to 1 for all a > 0. In Fig. g we 
illustrate this behaviour, both from formula (^ ) and using 
an iterative solution of eq. (|3^ ) . 

Hence it appears that a drastic change in the group 
behaviour is expected to occur when the average degree 
of mutual influence represented by ( |35| , ^ ) starts to com- 
pensate for the statistical "insignificance" of an individual 
(observe the compensation in the exponent of eq. (^)). 



Fig. 4. W{n) vs n from the exact summation (lines) and Monte 
Carlo simulation (points with error bars) for various aggrega- 
tion types, for wq — 0.1, a = 0.3, ~ 1/3.5. Also shown is 
Wq , for comparison. 



We now turn to the exact solutions to see more pre- 
cisely what happens. Since the number of partitions in 

the sum in (|l]) increases as 2 2 we could sum exactly 
the combinatorial formula ( ^l| ) to evaluate W{n) only for 
71 up to ~ 7. An exact algorithm based on the iterative 
solution (22,2^) allowed us to go up to n about 11, we 



I 



restricted ourselves to ?i = 9 for systematic runs. Large n 
were reached by Monte Carlo analysis using (28-3^. 
For a check of the MC accuracy we compare in Fig. 
the MC calculation with the exact summation for the 
case of homogeneous interaction (|2^j2^) (infinite correla- 
tion length ^). Here and below the errors quoted do not 
account for statistic correlations in the data and are only 
indicative for the stability of the latter. In the region of 
very small probabilities the Monte Carlo data for large n 
are seen to systematically underestimate the result by up 
to 30%, which may be due to insufficient thermalization 
of our runs (we start with a random bond configuration 
and perform 10000 thermalization sweeps at each n) ~ 
otherwise the agreement is very good. 

We also can see on Fig. ^ that the "refined approx- 
imation" of section 4.2 does provide a lower limit and 



is better than the mean field approximation in the re- 
gion of the minimum of W{n), while the latter describes 
more accurately the asymptotic regime. Both of them, 
however, are rather far from the exact and MC results. 
While providing qualitative insights and predicting cor- 
rectly the position of the minimum and the asymptotic 
behaviour, the mean field approximation fails even at the 
semi-quantitative level: the value of W{n) near the mini- 
mum is underestimated by orders of magnitude. 

For the more realistic (finite correlation length ^) case 
we show in Fig. ^numerical results (exact summation and 
Monte Carlo simulation) for distance dependent interac- 
tion K (11,11), using Wo = 0.1, a = 0.3 and ^0 = 1/3.5 
for various types of aggregation: a = 0, 0.5, 0.6, 0.65, 0.75 
and 1 (^6|) . We see that even for small a (extensive aggre- 
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gation) the presence of correlations can increase W{n) by 
a large factor. The most interesting result is, however, the 
indication of the existence of an ao much below 1, such 
that for a > ao W{n) does indeed develop a minimum 
after which it grows to 1 as suggested by ( |49| ) and (p8|). 
The minimum is rather shallow and can appear already 
at small n. Hence, ensembles which do not "expand" fast 
enough with increasing number of points (i.e., for which 
the size of the system measured in correlation lengths, n/^ 
increases only as a small power of n, 1 — a < 1 — ao) are 
intrinsically unstable under induced behaviour. 

As a side remark, we notice again the large difference to 
the mean field approximation, especially in the interesting 
turn over region - compare Figs. || and ^. This points 
to the benefit of having exact solutions and algorithms 
allowing faithful numerical analyses. 

Consider now an ensemble whose spatial organization 
can vary, for fixed n, then we can ask: 

Question 2: Assuming a constant interaction scale, how 
does W behave if the density of the points varies ? 

Roughly, this means that the strength of the correlation 
varies. In Fig. || we show the dependence of W on the den- 
sity p (i-e^ on K) for the homogeneous interaction case, 
^ oo ( ^ , p6|) (exact summation) for n = 25, 50, 100 and 
200 using the ad hoc rule: 

K{n) = p(20/n)°-^8 (gg) 

to bundle the data and allow comparison of various n. 

For the general case (finite ^) we show in Fig. |^ W 
from the Monte Carlo simulation for three values of n as 
function of the density p, where we take 

e(n,p) = eop. (51) 

We see that fluctuations of the density can easily desta- 
bilize the ensemble if the latter is near some "critical" 
density, Pc{n). For large n the critical fluctuations appear 
to be oc const/ ^Jn. 

Also other ways of introducing a scale or for posing the 
stability question can be imagined. In the above discussion 
the parameters have been chosen more or less arbitrarily. 
Of course, the explicit results depend on the particular 
problem: the form of the function K{d), the spatial ar- 
rangement, the aggregation form etc. It seems, however, 
that we see here a generic feature of induced behaviour, 
namely the capability to produce collective effects and 
that we are able in the frame of this probabilistic model 
to provide a quantitative analysis of this capability. 




0.05 0.1 0.15 0.2 0.25 0.3 0.35 



Fig. 5. The dependence ofW on K for the homogeneous inter- 
action case (infinite correlation length) for wo — 0.2 
and n = 25, 50, 100 and 200. W is plotted here vs p (the 
density) using formula to bundle the curves. 



0.9 - 

0.8 - f / j,-^ 

0.7 - ,' g*' 

0.6 - if 

0.5 - .y ^ n= 25 ^ 

i i n= 50 ^ 

,, n^lOO 

0.4 - / 
f: 

0.3 - / 
// f 

0.2 - / ^ / 

/* / i 
0.1 - / ,.' 

1 — s ^ ^ c ^^'f- -a" h" I ' 1 ' 1 

10 20 30 40 50 60 70 

Fig. &. W vs p (the density) for the general case from the 
Monte Carlo simulation for n = 25, n = 50 and n = 100 and 
Wo = 0.1, a = 0.3 and ^o = 1/3.5. 
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